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SUMMARY 


The  cadet  who  graduates  from  training  relatively  quickly  is  less 
expensive  to  train  and  conceivably  could  possess  better  flight  proficiency 
than  the  cadet  who  is  slow.  This  study  investigated  training  time  of  suc- 
cessful cadets  as  a means  of  obtaining  "purer"  criterion  groups  for  research 
purposes. 

Results  shoved  that  17.2  months  were  required  for  the  average  suc- 
cessful cadet  of  fiscal  1951  to  complete  training.  The  typical  class  had 
a range  of  seven  months  between  graduation  of  its  "slowest"  and  "fastest" 
cadet.  The  variability  in  training  time  among  successful  cadets  appears 
to  be  large  enough  for  its  adoption  63  a criterion  measure. 


The  question  of  the  validity  of  such  a criterion,  however,  must  be 
demonstrated.  In  order  to  show  this,  data  relevant  to  flight,  ground 
instruction,  and  leadership  performance  were  analyzed.  The  flight  jackets 
for  the  Jtt^Jadets  who  completed  training  in  15  months  were  compared  on  these 
variables  with  those  for  the  ^^fadets  who  required  20  or  more  months  to 
complete.  These  two  groups  represented  the  fastest  and  slowest  5 percent 
of  the  total  successful  sample  with  respect  to  training  time.  Analysis 
showed  that  cadets  who  are  slow  to  complete  training  are  characterized  by 
generally  poor  performance,  particularly  with  respect  to  flight  proficiency. 
The  fast  group  of  cadets  was  superior  to  the  slow  on  over-all  flight  per- 
formance, basic  and  advanced  flight  ratings,  and  total  number  of  flights 
required  to  complete  basic  and  advanced  training.  The  fast  group  of  cadets 
also  had  fewer  unsatisfactory  flights  in  basic  and  advanced  training,  fewer 
board  actions  taken,  and  fewer  accidents  throughout  training.  All  these 
differences  were  statistically  significant. 


The  fast  group  was  consistently  superior  to  the  slow  in  flight  per- 
formance throughout  the  different  training  phases,  although  the  difference 
between  the  two  groups  in  certain  instruction  and  leadership  ratings  had 
disappeared  during  the  advanced  training  phase. 

Further  follow-up  on  these  97  selected  cadets  for  their  fleet  per- 
formance is  recommended.  If  the  slow  group  of  cadets  continue  to  show 
significantly  poor  flight  performance,  it  would  seem  advisable  to  fail  them 
during  training. 


For  purposes  of  research,  it  is  recommended  that  successful  cadets  who 
require  20  or  more  months  to  complete  training  be  eliminated  from  the  pass 
group  when  used  as  criterion.  It  is  apparent  from  the  results  reported 
here  that  their  flight  performance  is  similar  to  the  cadet  group  who  have 
failed. 


A special  report  is  currently  being  prepared  in  which  training  impli- 
cations from  this  study  will  be  presented. 


TECHNICAL 


SUPPORTING 
DATA 


INTRODUCTION1* 


Criterion  development  is  an  important  aspect  of  a research  program 
since  predictors  can  be  no  better  than  the  criteria  against  which  they  were 
validated.  One  frequently  used  method  for  test  validation  is  the  compari- 
son of  the  test  performance  of  a group  which  has  completed  training  versus 
the  performance  of  a group  terminating  training  either  by  failure,  voluntary 
withdrawal,  or  other  causes.  This  method  is  useful  primarily  because  termi- 
nation from  training  is  a critical,  evaluative  decision.  Furthermore,  termi- 
nation by  failure  of  an  individual  from  training  represents  an  over-all 
Judgment  of  extremely  poor  performance.  However,  it  identifies  only  the 
individuals  at  the  low  end  of  the  distribution  of  talent.  Thus,  pass-fail 
criterion  groups,  while  useful,  represent  relatively  crude  distinctions. 

Some  dissatisfaction  with  pass-fail  criterion  groups  has  long  been 
recognized.  However,  it  is  a considerable  problem  to  secure  techniques 
whereby  finer  discriminations  in  performance  may  be  made.  Various  per- 
formance ratings  such  as  grades  are  often  assigned  individuals  in  training 
programs  and  sometimes  are  very  useful  for  criterion  refinement.  Because 
of  problems  of  reliability  and  validity,  however,  they  are  sometimes  suspect 
or  difficult  to  obtain. 

In  a few  situations,  training  time  itself  may  be  a useful  means  of  re- 
fining the  pass  criterion  group.  For  example,  in  Naval  Air  Training,  the 
cadets  are  assigned  to  classes  for  ground  school,  and  then  proceed  at  an 
individual  rate  through  flight  training.  From  previous  experience  it  is 
estimated  that  approximately  l8  months  are  required  for  a cadet  to  receive 
his  wings.  Since  progress  beyond  ground  school  in  the  flight  phase  varies 
from  cadet  to  cadet,  the  question  arises  as  to  the  variability  present  in 
training  time  among  successful  cadets.  There  would  seem  to  be  many  acci- 
dental reasons  that  might  cause  cadets  to  be  slow  in  completing  training. 
However,  it  seems  reasonable  to  believe  that  cadets  who  complete  training 
quickly  would  be  characterized  by  good  ability,  strong  motivation,  or  both. 
If  this  hypothesis  is  borne  out,  we  have  a simple,  objective  means  of 
purifying  the  criterion  of  success  in  training. 

This  study,  then,  is  part  of  our  attempt  to  purify  pass-fail  criterion 
groups.  The  extent  of  variability  in  training  time  among  successful  cadets 
must  be  large  enought  to  be  useful.  Furthermore,  recommendations  for 
purifying  criterion  groups  may  be  made  only  if  training  time  is  related  tc 
performance  as  a Naval  Aviator  in  a systematic  fashion.  To  tne  extent  that 
other  training  programs  allow  for  individual  variation  in  time  to  complete, 
the  findings  may  be  of  general  methodological  interest. 

METHOD 

This  study  was  performed  on  classes  14-50  through  14-51,  a toted  of 
2 6 classes  and  9^8  successful  cadets.  These  claeren  were  the  latest  for 


* The  writer  wishes  to  express  his  appreciation  for  the  valuable  suggestions 
given  by  Dr,  W.  B.  Webb  throughout  this  study. 


2 


which  sufficient  tine  had  elapsed  so  that  their  members  would  have  had  an 
opportunity  to  graduate. 

Training  time  was  determined  by  sub tr suiting  the  date  of  entry  into 
training  from  the  date  commissioned.  Training  time  was  rounded  to  the  near- 
est month;  less  them  15  days  were  disregarded,  15  or  more  days  were  counted 
as  an  extra  month.  A toted,  frequency  distribution  was  made  from  the  sepa- 
rate distribution  of  the  2 6 classes  since  the  distributions  of  time  for  the 
separate  classes  were  fairly  coiqpar able. 

The  flight  jackets  of  extremely  fast  and  slow  cadets  were  selected  for 
special  study  as  a m_cms  of  determining  wh  ither  late  completion  was  also 
characterized  by  poor  performance.  The  fast  cadet  group  included  the  47 
students  who  completed  training  in  15  months;  the  slow  group  included  the 
50  students  who  completed  training  in  20  or  more  months.  These  97  cadets 
represent  about  10  percent  of  the  total  graduate  population  of  fiscal  1951. 

The  data  from  the  flight  jackets  selected  for  comparative  purposes  in- 
cluded: over-all  flight  grades,  ground  school  grades,  flight  grades, 

officer-like  quality  ratings,  delinquency  reports,  total  number  of  flights, 
number  of  unsatisfactory  flights,  number  of  boards,  and  number  of  accidents. 
Wherever  possible,  these  variables  were  studied  separately  for  pre-flight, 
basic,  and  advanced  training  stages.  ACT  and  MCT  scores,  measures  of 
scholastic  and  mechanical  aptitude  respectively,  were  also  available  from 
the  flight  Jackets.  Appropriate  statistical  tests  were  applied  in  order  to 
coup  are  the  performance  of  the  fast  and  slow  cadet  groups  on  the  above 
variables.  In  most  comparisons,  this  involved  the  use  of  student's  "t" 
test  for  testing  the  significance  of  mean  differences. 

RESULTS 


The  average  successful  cadet  for  fiscal  1951  required  17.2  months  to 
finish  Naval  Air  Training  (Table  I).  The  standard  deviation  for  the  distri- 
bution of  months  of  training  was  1.5  months.  A breakdown  for  each  of  the 
26  classes  investigated  showed  that  the  typical  class  had  a range  of  seven 
months  between  graduation  of  its  slowest  and  fastest  cadet.  However,  82 
percent  of  the  causes  completed  within  a three  month  period  (l 6 to  l8  months) 

In  general,  variability  in  training  time  among  successful  cadets  is  not 
pronounced,  although  the  magnitude  is  sufficient  for  its  use  as  a measurable 
variable. 

The  next  question  concerned  differences  in  ability  between  fast  and 
slow  cadets.  Flight  jacket  data  were  tested  for  significance  of  differences 
and  these  results  are  suamarlzed  in  Tables  II,  III  and  IV.  The  flight 
Jacket  variables  were  classified  Into  three  major  headings:  flight,  ground 

Instruction,  and  leadership  performance. 

The  fast  group  of  cadets  was  significantly  superior  in  all  variables 
classified  under  the  heading  of  flight  performance  (Table  II).  Not  only 
were  these  differences  'statistically  significant,  but  many  were  so  large 
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that  there  was  relatively  little  overlap  "between  the  two  groups  (Table  V). 
Furthermore,  the  superiority  of  the  fast  group  in  flight  performance  v&s 
maintained  throughout  the  training  cycle.  This  was  evidenced  by  better 
performance  in  advanced  training  as  well  as  basic  for-  the  fast  cadets  on 
flight  instruction;  they  also  had  fewer  unsatisfactory  flights,  and  fewer 
total  flights  required  to  complete  advanced  training. 

Throughout  the  training  cycle,  there  were  about  lA  times  as  many  board 
actions  for  the  slow  group  as  the  fast.  The  slow  group  produced  slightly 
over  four  times  as  many  accidents  as  the  fact  group.  Both  these  comparisons 
show  significant  differences,  as  tested  by  x2* 

These  data  offer  striking  evidence  that  extremely  slow  training  time 
is  characterized  by  extremely  poor  flighc  performance. 

The  slow  group  is  also  characterized  by  significantly  poorer  per- 
formance than  the  fast  group  in  ground  instruction  during  pre-flight  and 
basic  training  phases  (Table  HI).  However,  during  advanced  training  the 
two  groups  do  not  differ  significantly  in  ground  instruction  performance. 

The  two  groups  also  do  not  differ  significantly  with  respect  to  scholastic 
and  mechanical  aptitude  as  measured  by  xhe  Aviation  Classification  Test  and 
the  Mechanical  Comprehension  Test.  However,  the  fast  group  is  practically 
always  characterized  by  better  performance  on  all  variables,  including  those 
such  as  the  ..CT  and  MCT,  although  statistical  significance  Is  not  attained. 
It  should  be  recalled  that  the  ACT  and  MCT  tests  are  used  for  selection, 
and  cadets  with  low  scores  on  these  variables  do  not  enter  training.  Conse- 
quently, the  failure  of  these  tests  in  predicting  training  time  itself  is 
only  relative.  This  is  particularly  true  since  cadets  who  complete  train- 
ing quickly  are  superior  to  the  slow  group  on  these  two  variables,  approach- 
ing statistical  significance  in  the  case  of  the  Mechanical  Comprehension 
Test. 


With  respect  to  military  leadership  as  shown  on  officer-like -quality 
ratings,  the  slow  group  is  characterized  by  significantly  lover  ratings 
during  pre-flight  and  basic  training  phases  (Table  IV).  During  advanced 
training,  however,  the  difference  between  the  two  groups  oa  leadership 
ratings  is  not  statistically  significant.  Delinquency  reports  are  given  to 
cadets  for  such  conduct  as  being  late  for  formation,  failure  to  salute  an 
officer,  untidy  rooms,  and  the  like.  They  have  been  included  in  the  leader- 
ship realm,  although  they  may  not  be  unequivocally  placed  in  this  category. 
The  slow  group  is  characterized  by  more  delinquency  reports  during  pre- 
flight and  basic  training  stages,  but  the  difference  is  significant  only 
at  the  5 percent  level  of  confidence  during  the  latter  training  phase.  No 
delinquency  reports  were  given  to  either  group  during  advanced  training. 

The  mean  scores  for  many  of  the  flight  jacket  variables  have  been 
placed  in  standard  score  form,  with  the  mean  equal  to  50.  On  this  basis, 
it  can  be  seen  (Tables  II,  III  and  IV)  that  the  slow  group  is  further  below 
average  on  most  variables  studied  than  the  fast  group  is  above  average.  For 
example,  on  over-all  flight  performance,  the  mean  rating  for  the  fast  group 
wa s 53*3^  as  compared  to  a mean  of  HA .11  far  the  slow  group. 
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The  frequency  distributions  presented  in  Table  V highlight  the  differ- 
ences between  the  fast  and  slow  cadet  groups  on  selected  flight  performance 
variables.  For  example,  in  over-all  flight  performance  ratings  84  percent 
of  the  slow  group  receive  standard  scores  below  44,  whereas  only  25,5 
percent  of  the  fast  group  receive  scores  below  this  value.  On  this  same 
variable,  40  percent  of  the  slow  group  receive  standard  scores  of  39  or 
lower  while  none  of  the  fast  group  are  in  this  interval.  Results  of  this 
kiai  show  strikingly  the  extremity  of  performance  differences  between  fast 
slow  cadets. 


DISCUSSION 


At  the  outset  of  this  research  it  was  felt  that  fast  cadets  would  show 
superior  performance,  but  that  alow  cadets  would  not  necessarily  be  charac- 
terized by  poor  performance.  This  belief  was  held  because  of  the  apparent 
Importance  of  many  possible  accidental  factors  such  as  health  or  weather 
which  might  cause  a cadet  to  be  slow.  The  results  indicate,  however,  that 
such  accidental  factors  are  relatively  unimportant  in  causing  a cadet  to  be 
slow.  Rather,  slow  performance  generally  is  characterized  by  less  adequate 
performance. 

This  study  has  dealt  with  total  training  time,  but  it  would  be  im- 
portant to  check  whether  the  cadet  who  is  very  slow  during  basic  training 
is  also  slow  during  advanced  and  perhaps,  more  critically,  in  the  fleet 
itself.  The  chances  appear  good  that  such  a relationship  will  be  found 
bared  on  the  poor  flight  performance  shown  in  advanced  training  by  the  slow 
group.  However,  the  strength  of  this  relationship  should  be  determined 
since  completion  of  basic  training  itself  is  often  used  as  a criterion  of 
success. 

During  the  advanced  training  stages,  it  will  be  recalled  that  ground 
instruction  and  military  leadership  ratings  did  not  differentiate  the  fast 
and  8 low  groups.  Aside  from  the  possibility  that  ratings  on  these  variables 
are  not  so  meaningful  in  advanced  as  earlier  training  phrsss,  there  are  two 
other  important  possibilities.  Cadets  who  are  poor  in  flight  performance 
during  basic  training  may  be  failed  if  they  have  not  shown  improvement  in 
leadership  and  ground  instruction  performance  during  that  time.  Board 
officers  may  be  inclined  to  retain  the  cadet  who  compensates  for  poor  flight 
performance.  Selective  drop-out  on  this  basis  may  account  for  the  failure 
to  find  differences  in  advanced.  The  other  major  possibility  is  that  actual 
improvement  in  leadership  and  ground  instruction  performance  has  occurred 
for  all  cadets.  Further  investigation  to  discover  which  of  these  two  possi- 
bilities is  most  likely  is  worthwhile. 

The  analysis  in  this  report  was  based  on  extreme  cases,  about  5 percent 
of  the  total  sample  in  each  of  the  fast  and  slow  groups.  It  is  not  feasible 
to  use  only  those  few  cadets  who  complete  training  in  15  months  as  the 
criterion  group.  However,  if  it  may  be  assumed  that  training  time  is  a 
linear  function  of  success,  we  can  sake  recommendations  for  purifving 
criterion  groups.  The  larger  the  successful  sample  of  cadets  t'.^.t  are 
available,  the  more  we  can  refine  the  successful  group.  From  the  data 
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presented  here,  cadets  who  take  20  or  more  months  to  complete  training 
should  be  eliminated  from  the  criterion  group.  If  the  sample  of  successful 
cadets  is  large  enough  to  permit,  it  is  recommended  that  cadets  who  complete 
in  19  months  also  be  eliminated.  From  Table  I,  it  is  estimated  that  elimi- 
nation from  the  successful  group  of  those  cadets  who  require  19  or  more 
months  of  training  time  should  reduce  the  criterion  sample  by  about  10  per- 
cent. Thus,  this  refinement  is  a practical  one. 

The  weaker  the  relationship  between  the  predictor  anl  pass-fail 
criterion,  the  greater  is  the  need  for  eliminating  cases  of  this  kind.  If 
these  cases  were  included,  significant  correlations  can  be  found,  but  they 
would  become  more  significant  by  elimination  of  the  extremely  slow  cadets. 
The  danger  from  their  inclusion  is  that  they  may  vitiate  a significant 
correlation. 

Implicit  throughout  this  discussion  has  been  the  acceptance  of  flight 
Jacket  data  as  evidence  for  validity.  The  question  arises  as  to  why  these 
data  alone  migrt  tvrt  be  a more  direct  means  of  criterion  refinement.  This 
possibility  itself  is  being  currently  evaluated  in  other  research  studies 
by  other  investigators.  Eventually,  performance  ratings  themselves  may 
serve  as  a criterion  purification  technique.  In  the  interim  the  importance 
and  objectivity  of  training  time  makes  it  an  intriguing  variable  for  further 
study.  The  import sace  of  the  time  variable  in  Naval  Air  Training  may  en- 
courage investigators  elsewhere  to  explore  its  utility. 
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TABLE  I 


TIME  TO  COMPLETE  PROGRAM 
CLASSES  14-50  THROUGH  14-51 

(N  = °88) 


Number  of  Months 

15 

16 

IT 

18 

19 

20 
21 
22 
25 
24 


Frequency 

47 

253 

566 


69 

30 

13 

3 

1 


N = 988 


Mean  =*  17.2  Months 

Standard  Deviation  = 1.3  Months 


Range  **  10.0  Months 


TABLE  II 


COMPARISON  OP  FAST  AND  SLOW  CADET  GROUPS 
ON  FLIGHT  PERFORMANCE  VARIABLES 


Fast  Group  (N=47)  Slow  Group  fffr«50) 


Variable 

Mean 

S.D. 

Mean 

S.D. 

»t«. 

1. 

Over-all  Flight  Grade 

53.3 

6.9 

44.1 

7.5 

6.24* 

2. 

Basic  Flight  Instruction 

50.7 

8.3 

39.2 

6.1 

7.68* 

3. 

Advanced  Flight  Instruction 

53.5 

8.1 

43.6 

7.0 

6.39* 

4. 

Total  Flights  Basic 

146.6 

9.7 

163.3 

9.9 

9.29* 

5. 

Total  Flights  Advanced 

51.9 

23.5 

76.6 

18.8 

5.65* 

6. 

Unsatisfactory  Flights  Basic 

1.5 

1.2 

5.9 

2.7 

9.93* 

7. 

Unsatisfactory  Flights  Advanced  0.6 

1.0 

2.2 

2.0 

5.00* 

8. 

Number  of  Accidents 
(Throughout  training) 

3 

13 

* 

9. 

Number  of  Boards 
(Throughout  training) 

5 

72 

* 

• 

t significant  beyond  1 percent 

level 

of 

confidence. 

#* 

X2  significant  beyond  1 percent 

level 

of 

confidence. 

TABLE  HI 


COMPARISON  OP  FAST  AND  SLOW  CADET  GROUPS 
ON  GROUND  INSTRUCTION  VARIABLES 


1. 

2. 

3. 

4. 

5. 


Fast  Group  (N=47)  Slov  Group  (N=5Q) 


Variable  Mean 
Ground  Instruction  Pre -Flight  52.5 
Ground  Instruction  Basic  51.5 
Ground  Instruction  Advanced  50.5 
Aviation  Classification  Test  86.7 
Mechanical  Comprehension  r.7est  60.8 


S.D. 

Mean 

S.D. 

"t" 

6.4 

45.7 

8.6 

4.58* 

9.1 

45.9 

10.5 

2.79* 

8.9 

49.4 

9.4 

0.56 

9.9 

85.3 

11.5 

0.63 

7.1 

58.2 

8.0 

1.66 

« 


t olgnlf leant  at  the  1 percent  levol  of  confidence 


TABLE  IV 


COMPARISON  CP  PAST  AND  SLOW  CADET  GROUPS 
ON  LEADERSHIP  VARIABLES 


Fast  Group  (IE=47)  Slow  Group  (N»50) 


Variable 

Mean 

S.D, 

Mean 

S.D, 

"t" 

. OLQ*  Ratings,  Pre-Flight 

55.8 

5.7 

53.0 

5.3 

2.48** 

. OLQ*  Ratings,  Basic 

50.7 

7.4 

46.1 

8.4 

2.79* 

. OLQ*  Ratings,  Advanced 

53.5 

7.0 

54.6 

7.5 

1.80 

. Delinquency  Reports,  Pre-Flight 

1.9 

1.6 

2.5 

2.4 

1.4l 

. Delinquency  Reports,  L_nic 

1.9 

1.4 

2.6 

2.2 

2.03 

°OLQ  =**  Officer-Like-Quality 

* t significant  at  the  1 percent  level  of  confidence. 
**  t sKPiif leant  at  the  5 percent  level  of  confidence. 


TABLE  V 


COMPARISON  OF  SLOW  AND  FAST  CADET  GROUPS 
ON  SELECTED  FLIGHT  PERFORMANCE  RATINGS 


Standard  Score 
Rating 

Over -all 
Flight  Grade 

Basic  Flight 
Instruction 

Advanced  Flight 
Instruction 

Slow 

Fast 

Slow 

Fast 

Slow 

Fast 

25-29 

0 

0 

*1 

A. 

r\ 

1 

C 

50-54 

5 

0 

9 

0 

e; 

y 

0 

55  - 59 

17 

0 

15 

5 

10 

1 

40-44 

8 

5 

17 

9 

15 

7 

45  - 49 

8 

8 

4 

12 

11 

8 

50-54 

9 

15 

5 

10 

5 

10 

55  - 59 

4 

c 

y 

1 

6 

2 

8 

6o-64 

1 

7 

0 

4 

1 

10 

65  - 69 

0 

2 

0 

2 

0 

2 

70-74 

0 

1 

0 

1 

0 

0 

75-79 

_0 

0 

0 

0 

_0 

1 

N - 50 

47 

50 

47 

50 

47 

